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STOCHASTIC  GREEDY  BIN-PACKING 
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Abstract 

An  adaptive  or  greedy  p)olicy  for  packing  I  bins,  or  equivalently 
for  scheduling  jobs  for  the  attention  of  a  number,  I,  of  processors  is 
studied.  It  is  shown  that  the  suitably  normalized  bin  contents 
become  nearly  jointly  but  degenerately  Gaussian/normal  if  the  rate 
of  approach  of  jobs  becomes  large.  Explicit  and  simple  parameter 
characterizations  are  supplied  and  the  asymptotics  are  compared 
with  simulation.  The  advantage  of  the  greedy  p>olicy  over  a  laissez- 
faire  policy  of  equal  access  is  quantified,  and  seen  to  depend  upon 
-^number  of  bins  or  processors . 

Introduction 

We  study  an  adaptive  or  greedy  policy  for  packing  I  bins,  or  equivalently  for 
scheduling  jobs  for  the  attention  of  a  number,  /,  of  processors.  The  connection 
between  bin-packing  and  makespan  scheduling  is  well  described  in  Coffman  and 
Lueker  [1],  chapter  1. 

It  is  shown  that  the  suitably  normalized  bin  contents  become  nearly  jointly 
but  degenerately  Gaussiein/normal  if  the  rate  of  approach  of  jobs  becomes  large. 
Explicit  and  simple  parameter  characterizations  are  supplied,  and  the  asymp¬ 
totics  are  compared  with  simulation.  The  advantage  of  the  greedy  policy  over  a 
laissez-faire  policy  of  equal  access  is  quantified,  and  seen  to  depend  upon 
-^number  of  bins  or  processors . 
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Greedy  Bin-Filling 

There  are  1  bins  (potential  servers).  Jobs  arrive  at  the  bin  system  according  to 
a  homogeneous  Poisson  process,  rate  A.  Each  job  size  is  independently  and 
identically  distributed  according  to  Fsix);  a  generic  job  size  is  B,  a  real  positive 
random  variable.  Let  N,<f)  denote  amount  of  work  in  bin  i  at  time  t;  this  is  the  sum 
of  the  job  sizes  deposited  in  that  bin  up  to  time  t.  We  refer  to  N,(0  as  the  bin  size 
at  time  t  hereafter,  although  other  terminology  is  used  in  the  scheduling 
literature. 

Consider  Polio/  E  (Equalization):  When  a  nev\’  job  arrives  it  is  deposited  in  the 
bin  with  smallest  amount  of  accumulated  work.  Nit)  =  [Njit),  t>0,i  €  (1, 2, ...,  /)) 
is  a  Markov  process  with  the  following  generator;  for  d  >  0 


N,it  +  A)  =  Niit)  with  probability  1  -  A4p,(N,(f),  Nit))  +  oiA) 


-  Niit)  +  Bit)  with  probability  XApiiNjit),  Nit))  +  oiA)  (1> 


Define 


1  if 


[0  otherwise 

Consider  also  Probabilistic  Policy  E;  same  as  above  but 


where  hi-)  is  a  positive  homogeneous  function  chosen  to  become  large  when  N,(f) 
is  small;  e.g.  hix)  =  x'P.  Such  a  policy  leads  to  workload  growth  very  similar  to 
Policy  E's,  but  can  be  analyzed  more  readily.  See  Gaver,  Morrison  and  Silveira  [2] 
for  application  of  such  a  probabilistic  policy  in  a  service-system  scheduling 
context.  In  the  present  context,  the  bins  can  be  buffers  containing  jobs  to  be 
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processed  later  and  the  aim  is  to  keep  the  total  processing  time  short;  it  is 
(optimistically)  assumed  that  the  contents  of  each  bin  is  known  at  all  times  to  the 
scheduler  and  that  each  processing  time  is  knoum  when  the  job  or  task  appears. 


Joint  Moment-Generating  Function 

Let  the  moment-generating  function  (assumed  to  exist,  otherwise  use  the 
characteristic  function)  be 


(d) 


expj 

f  ^  Y 

l7=i 

(3) 


Condition  on  N,(t),  i  £  (1,  2, I)  and  use  the  generator  to  obtain 


'  '1 

exp 

Ie,N,(i+A) 

NU),B{I) 

J=1  ) 

=  [1  -  AAjexp 


0=1 


/ 


;=i 


r 


exp 


k*i 


+  o(A). 


V  ^*1  J 

Remove  conditions,  defining  the  m  g  f  of  the  task  size  arriving  at  f,  B{t),  to  be 
b{d),  to  find 

7=1 


Let  A  0  to  get 

Note  that  nothing  that  follows  prevents  non-stationary  input  rates:  i.g.  A  =  Ar(0, 
and  the  mgf  of  B(t)  to  be  b{d;t)  provided  these  do  not  drop  quickly  to  zero. 


3 


Scaling 
Put 

and  let  A  »  1.  It  is  anticipated  that  with  suitable  choice  of  the  functions  Ipjit)} 


NAt)-XPAt) 
X.l=  r'rr--^ 


(5) 


(d)  , 
9(e,f;A)  =  E 


( f  V 

exp 

l/=l  J. 

for  Xj(t)  defined  as  above.  Note  that 


^ 

exp  /  VI)^’;(0 


=  v/(0  /  VX,f) 


=  E 


1; 

=1 

1 

r 

( i  V 

■ 

(  ^  ] 

exp 

I0;X^(O 

exp 

VAX0^j3^(f) 

[m  j 

. 

1  M  J 

=  (jo(e,f;A)exp(VA0/?(f)). 


(6) 


Now  since  from  (4) 


;=1  L 


substitution  of  (5)  yields 


=  |[^(e,a)exp(Vl9/J(0)]  =  ^5^exp(VIe/)(0) 

+<p(0,l;A)(VA0/3'(f)exp(Vl0^(O)) 

= -A<p(0,f;A)exp(VA^;3(t))  + 

+A fh(0y  /  VA)E[exp(0X(f)) •  exp(VA 0/3(0) •  P;(A^;(0  +  ^^Xy(0; +  VAX J 

/=! 
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Cancel  exp(VA  0)3(/))  to  obtain 

+  <pid,  t;  X  )Vr0/J'(O  =  -^(p{e,  t;  X ) 

ot 

+X  j^b[ej  /  VI)E[exp(dX(/)) •  pj[Xp|{t)  +  ^^XX|{t);XP  +  VIx)]. 
;=■» 


k=l  it=l 

where  h(-)  is  homogeneous:  /iWat)  =  XPh(x).  Consequently 

p,(A/i,(0-^VAX,(();A/3(<)■>-^'Xx(())= 

IKftW+Xfcdj/VX) 

it=l 

(/i(.r)  V  assumed  to  be  differentiable).  Expand  in  inverse  powers  of  VT : 


p^(xp^(f)-^VXXj(t);XP(t)^VXX(t))  = 


ru(R.lA\  1  <:=!  ^  ^ 


'L^iPkii))  'ZKPki^))  Yh{Pk{t)) 

k—^  ^—1  ,  L_i 


Since 


Xp,  (/)  +  VIX;  (();  A/5(()  +  n/Ix(())  =  1 
H 


*:=!  (9,a) 
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this  implies  that  the  summed  coefficients  of  1/Vr,l/A,  etc.  must  be  indi¬ 
vidually  zero;  this  is  easily  verified  for  the  coefficient  of  1  /  VA  . 


Asymptotic  Expansion  For  <p{e,t;X). 

Put 

fp{6,t;X)=  +  — 

This  can  now  be  entered  into  (7)  and  evaluated  by  means  of  (9): 


(Vlf 


I  ( 


-All 


/To  (VI)*  /To' '(VI) 


j=l\k=0 


k\ 


I«’'77=7 

/=0  (VA) 


vt-i 


1 

*71 


/c=l 


lKp,{t)) 

U=i  y 


k=i  /=o'^^^  (Va) 


(10) 


+  Oll 


In  the  above  =  e[b^]/  the  moment  of  job  size;  of  course  fco  =  1- 

Now  identify  the  coefficients  of  inverse  powers  of  VI,  and  thereby  equations  for 
q)f  and  Pf  .  From  (10)  for  f  =  0, 
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U=i  J  J  Jo 

The  terms  of  order  A  cancel  from  the  r  h  s.  The  terms  of  order  \X  on  1  h  s  and 


r  h  s  cancel  if 


efiv)<rc  =  hIo,j^yn 

'  k 

In  order  for  this  to  occur, 

,-,2  )  (12) 

it 

the  solution  of  which  determines  pj(l). 

Next  look  for  terms  of  order  1.  The  1  h  s  provides  The  r  h  s  provides  the 

ef  Km) 


andtVff  ^<Po  VMn 

'  t  I,h(Mt)) 

^  \  k  J 

Note  that  the  condition  (12)  actually  annihilates  any  term  of  order  1  (or  higher)  in 
(p/foT  /  =  1, 2, ...  on  the  r  h  s,  and  the  discussion  of  (9,  a)  shows  that  there  is  no 
contribution  from  d(ptfddj.  Consequently 
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r  f 


1-1 


/ 


/=i 


V 


IHM)) 


K  k  J 


I 


1 


(13) 


I 

Note:  ^ 
/=! 


(if 


=  0. 


The  PDE  for  <po(0-f)  is  recognizable  as  that  of  an  Ornstein-Uhlenbeck  (Gaussian) 
process.  Similar  equations  for  higher-order  corrections  can  be  derived  similarly, 
but  we  omit  this  step. 


MOMENTS 

The  (0-^  order)  joint  moments  of  X(t)  =  (Xft),  j  =  1,  2, ...,  /)  satisfy  ordinary 

differential  equations  that  are  readily  obtained  by  differentiation  of  (13)  at  6=0. 
If  V,(f)  =  E[Xf  (/)],  V,j{t)  =  e[x,(/)X^(/)]  for  i  ^  j  then 


dVj 

dt 

dt 


=  b2P,(P,{t))  +  2b^ 


H,(f)P.(0-XH,^(/)V.f0 

ik) 


=  b, 


f  > 

\{k)  ik) 


ii*j) 


The  above  must  be  tailored  as  follows: 
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(14) 


dV,{t) 

dt 


^b2P^{f3,it))  +  2b^ 


k^i 


\ 

(k*j)  ^ 

Now  return  to  specifics;  consider  (12):  for  /  ^  A: 

dp, it)  ^  dpk(i) 
hiPjit))  hiPkit)) 

if  the  bins  are  filled  as  suggested.  This  implies  that 

P,it)  =  ^,  a\lje{l,2,...,I) 

and  p,{P,it))  =  1//. 

For  the  case  in  which  h{x)  =  x  p  it  can  be  seen  that 


Substitute  into  (14)  to  obtain  these  equations  for  Vj{t)  h  V{t),  (Vi); 


VAt)  =  WU),  (Vj^;): 


dV  _  b2  2p 


dt 


I  t 


7-1 

I  1 


:{v-iv) 


^  =  ^(V-VV), 
dt  It  ^  ' 

from  w'hich  an  equation  for  2(f)  =  V(f)  -  VV(f)  emerges: 


^3z(o4 

dt  t  I 


A  solution  to  (18)  over  t  e  (L,«>),  L  >  0  is  of  this  form: 


Z(f)  = 


b2t  ^  K(L) 

7(1 +  2p)'"  /2p  ' 


L<t 


(15) 


(16) 


(17,a) 


(17,b) 


(18) 
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From  this  and  (17,b) 


dt  It 


we  get 


and  from  (17,a) 


=  '  '  1  L<, 

l  +  2p/2  2p  L^’’} 


''  lH2p  +  l 


Now  if  p  »1  it  is  seen  that 


V(t)  =  Wit)B 


—  ^2^ 


r 


(19) 


(20) 


(21) 


Parenthetically,  the  comparable  figures  for  independently  filled  bins  are 


V(0  =  -^  and  W(0  =  0.  (22) 

From  (15)  and  (20) 

E[N,(/)]  =  A.‘^  +  0(VI) 

Vflr[N,(f)]  =  Coi|N,(0,Ny(f)]  =  Af  ^  +  0(VI) 

The  singular  behavior  of  W(f)  and  V(/)  for  small  t,  as  in  (19)  and  (20),  can  be 
attributed  to  the  indeterminacy  of  the  bin  selection  probability,  (2),  for  N,<0)  =  0, 
Vf,  which  was  the  assumed  initial  condition.  The  long-time  behavior  of  greedy 
packing,  expressed  by  (23),  is  of  interest:  since  Vflr[N,(f)]  =  Cor;[N,(f),  Nj{t)]  all  bin 
contents  are  essentially  perfectly  correlated  at  any  time.  Consequently,  to  order 
VA  the  maximum  bin  contents  Nmit),  are  approximately  normal/Gaussian  with 
mean  Xtb\/I  and  standard  deviation  If  bins  are  filled  independently 


the  mean  is  the  same  but  now  Nmit)  is  distributed  approximately  as  the 


maximum  of  I  independent  normals,  each  with  standard  deviation  /  V7  — 
considerably  larger  in  a  probabilistic  sense.  Note  that  putting  p  =  0  in  (19),  (20) 
yields  the  independent  result;  putting  p  finite  yields  other  probabilistic  options. 
In  the  scheduling  context  the  makespan,  i.e.  time  to  complete  all  tasks  present  at 
time  t,  is  substantially  reduced  by  the  current  greedy  scheme,  which  is  equivalent 
to  what  Coffman  et  al.  (1991)  call  list  scheduling  (LS);  our  approach  is  on-line  list 
scheduling,  meaning  that  tasks  are  assigned  to  processors  sequentially  as  they 
appear  in  time.  It  should  be  pointed  out  that  the  moments  obtained  above  can 
also  be  derived  directly  from  (1)  and  (2)  by  expansion  of  (5),  rather  as  suggested 
by  Isham  [3]. 

Simulations 

Limited  informal  simulations  were  conducted  in  order  to  check  the  accuracy 
of  the  proposed  asymptotic  approximations.  The  simulations  were  written  in 
APL2  and  conducted  on  an  AMDAHL  5995-700A  at  the  Nav'al  Postgraduate 
School  using  the  LLRANDOM  random  number  generator;  cf.  Lewis  et  al.  [4],  All 
simulations  were  run  for  time  f  =  1  at  the  indicated  A-values  for  two  job  size 
distributions,  both  gamma:  the  exponential  and  an  extended-tail  highly-skewed 
gamma  with  shape  parameter  one-half. 

Examination  of  Table  1  indicates  that  agreement  is  good  between  the 
asymptotic  approximation  and  simulation  results  (based  on  1000  replications)  for 
the  marginal  distributional  properties  of  an  arbitrary  bin  when  the  greedy  policy 
is  followed.  As  anticipated,  a  considerable  reduction  in  the  variance  of  bin  size, 
and  also  of  upper-tail  percentiles,  is  achieved  by  greediness,  as  contrasted  to  a 
simple  random  assignment. 

The  figures  of  Table  2,  which  describe  the  approximation  to  the  maximum  bin 
size,  or  makespan  in  a  scheduling  context,  are  serviceable  but  tend  to  be  low  or 


11 


optimistic,  especially  for  the  smaller  A-value  of  50.  For  A  =  300  the  agreement  is 
better  and  correctly  predicts  the  substantial  reduction  of  mean,  variance,  and 
upper  percentiles  achieved  by  the  greedy  policy.  Note  that  numerical  agreement 
between  simulation  and  our  asymptotics  should  improve  if  the  job  sizes  have 
smaller  variances  and  third  moments. 

It  can  be  conjectured,  and  demonstrated,  that  a  cyclic  or  round-robin  policy  of 
putting  every  arrival  in  the  same  bin  will  tend  to  reduce  within-bin  variance 
and  makespan  levels.  It  may  be  advantageous  that  both  random  and  round-robin 
policies  require  no  information  concerning  current  bin  size  or  occupancy  at  the 
time  an  assignment  must  be  made,  whereas  the  greedy  policy  and  others  depend 
on  precise  distributional  forms  do  require  such  information.  If  reduction  of  bin 
size  or  makespan  variation  is  important  the  acquisition  of  the  information 
needed  to  implement  a  greedy  policy  may  be  well  worth  the  cost. 
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Table  1.  ARBITRARY  BIN  SIZE 


7  =  5 

B:  G  =  1:  Gamma,  Shape  Param.  =  1  (Exponential) 
G  =  0.5:  Gamma,  Shape  Param.  =  0.5;  ElB]  =  1. 
Number  Replications  =  1000 


Mean 

Demand(A) 

Job 

Size  (B) 

Mean 

Policy 

Greedy 

Quantiles 

\'ar  807c  907c  Mean 

1 

Random 

Quantiles 
Var  807o  907c 

50 

G  =  1 

App:  10.0 

4.0 

11.7 

12.6 

10.0 

20.0 

13.8 

15.7 

Sim;  10.1 

5.0 

11.9 

13.0 

10.0 

19.6 

13.7 

16.1 

G  =  0.5 

App:  10  0 

6.0 

12.3 

13.1 

10.0 

30.0 

14.6 

17.0 

Sim;  10.0 

8.5 

12.1 

13.8 

10.2 

32.6 

14.8 

18.0 

300 

G  =  1 

App:  60.0 

24.0 

64.1 

66.3 

60.0 

120.0 

69.2 

74.0 

Sim;  60.2 

24.1 

64.4 

66.4 

60.4 

112.1 

69.5 

73.9 

G  =  0.5 

App:  60.0 

36.0 

65.0 

67.7 

60.0 

180.0 

71.2 

77.1 

Sim;  60.2 

38.9 

65.4 

68.0 

60.0 

172.7 

70.7 

77.1 
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Table  2.  MAXIMUM  BIN  SIZE 


1  =  5 

B:  G  =  1;  Gamma,  Shape  Param.  =  1  (Exponential) 
G  =  0.5:  Gamma,  Shape  Param.  =  0.5;  E[B]  =  1. 
Number  Replications  =  1000 

Policy 


Mean 

Demand(A) 

Job 

Size  (B) 

Mean 

Greedy 

Quantiles 
Var  80%  90% 

Mean 

Random 

Quantiles 

Var  80%  90% 

50 

G  =  1 

App: 

10.0 

4.0 

11.7 

12.6 

— 

— 

17.6 

19.1 

Sim: 

11.2 

5.2 

13.1 

14.2 

15.6 

15.1 

18.7 

23.9 

G  =  0.5 

App: 

10.0 

6.0 

12.1 

13.1 

— 

— 

19.4 

21.2 

Sim: 

12.2 

10.7 

14.8 

16.5 

16.9 

28.2 

20.7 

23.9 

300 

G  =  1 

App: 

60.0 

24.0 

64.1 

66.3 

— 

— 

78.7 

82.3 

Sim: 

61.5 

24.3 

65.6 

67.7 

73.3 

61.5 

79.5 

83.5 

G  =  0.5 

App: 

60.0 

36.0 

65.0 

67.7 

— 

— 

82.9 

87.3 

Sim: 

62.3 

40.0 

67.7 

70.3  i 

76.2 

107.6 

84.3 

90.4 

—  :  Not  convenient  to  compute 
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